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Abstract 

When designing vehicle vibration monitoring systems for aerospace devices, it is common to use well-established 
models of vibration features to determine whether failures or defects exist. Most of the algorithms used for failure 
detection rely on these models to detect significant changes in a flight environment. In actual practice, however, 
most vehicle vibration monitori ng systems are corrupted by high rates of false alarms and missed detections. This 
crucial roadblock makes their implementation in real vehicles (e.g., helicopter transmissions and aircraft engines) 
difficult, making their operation costly and unreliable. Research conducted at the NASA Ames Research Center has 
determined that a major reason -or the high rates of false alarms and missed detections is the numerous sources of 
statistical variations that are not taken into account in the modeling assumptions. 

In this paper, we address one such source of variations, namely, those caused during the design and manufacturing 
of rotating machinery components that make up aerospace systems. We present a novel way of modeling the vibration 
response by including design variations via probabilistic methods. Using such models, we develop a methodology 
to account for design and manufacturing variations, and explore the changes in the vibration response to determine 
its stochastic nature. We explore the potential of the methodology using a nonlinear cam-follower model, where the 
spring stiffness values are assumed to follow a normal distribution. The results demonstrate initial feasibility of the 
method, showing great promise n developing a general methodology for designing more accurate aerospace vehicle 
monitoring systems. 

•Submitted for Review, ASME Journal of Mechanical Design. Conference version published in DETC 2002 (DETC2002-DFM34161). 
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1 Designing Vehicle Monitoring Systems 

This work addresses a need to design effective vehicle health monitoring systems for aerospace vehicles. Ongoing 
research focuses on various source s of variation that result in unexpected performance variations. The current focus 
is in assuring that correct models of system input signals are used for the algorithms and metrics used for failure 
detection. This paper explores one aspect of modeling input signals in such systems, namely, the consideration of 
design and manufacturing variations for the system response variable that is being monitored, namely, the vibration 
signature. 

In the following subsections, ve first present some backgound research on vehicle health monitoring systems, 
two examples of the types of variations encountered in such systems, and discuss the need to incorporate probabilistic 
models to account for such variations. Then, the use of probabilistic methods (e.g., Monte Carlo simulation) is explored 
with a simple example in design, and compared to more traditional variation analysis techniques. Next, a lumped 
parameter dynamic model is presei ted for a complex cam-follower system used in this paper, followed by an analysis 
of vibration data obtained from sue h a model. Finally, the Monte Carlo simulation technique is used to vary a subset 
of the design parameters. The effect on the vibration response is explored to determine whether probabilistic methods 
can be used to model the inherent \ariations observed in the dynamic response of complex systems. 

1.1 Background and Objective 

Failures in rotating machinery for high-risk aerospace applications are unacceptable when they result in catastrophic 
accidents, and undesirable when thry result in high maintenance costs. In an attempt to detect any anomalous behavior 
during flight for increased safety, most aircraft manufacturers and operators are moving towards installing vehicle 
health monitoring systems. Despite the motivation to make these systems standard onboard aircraft, false alarms and 
missed detections still remain a serious concern, making their reliability questionable and their operation costly in 
practice. One of the main reasons for the high rate of false alarms and missed failures is the lack of a statistically 
sufficient sample of baseline and fa lure signatures from which generalizations can be made. Specifically, since failure 
events are rare in such highly-mairtained systems, there is no knowledge of the distribution of responses they could 
generate. 

Recent work at NASA Ames Research Center has demonstrated that the statistical variations in baseline (healthy) 
data must be accounted for to assure accurate anomaly detection in aircraft monitoring systems (Huff et ah, 2000; Huff 
et al., 2002; Turner and Huff, 2002; Turner and Huff, 2001). In this work, we address the mismatch between modeled 
responses and empirical observations by developing statistically-accurate models that take variations into account. The 
specific objective is to explore probabilistic approaches to generate a reliable distribution of vibration responses using 
lumped-parameter dynamic models. If such an approach proves feasible, more accurate models of healthy and faulty 
aircraft vibration data will be developed and used as signal models for vibration monitoring systems. 
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1.2 Observed Variations in Vibration Signatures 

For rotating machinery, vibration signals are thought to contain indicators of defects and usage damage in rotating 
components such as gears, bearings, shafts, rotors, etc. Each of the rotating components emanate specific frequencies 
that appear in the vibration signals; any changes in the amplitude and frequency content of these signatures, or the 
occurrence of sidebands or additional frequencies, is indicative of potential variations and defects. The types of 
variations of interest in this work nclude those that are inherent from the design and manufacturing processes (e.g., 
tolerances, assembly variations, surface roughness and waviness errors), material defects, cracks, and other point 
defects on the rotating components (Turner and Huff, 2001; Huff et al., 2002; Turner and Huff, 2002). In this paper, 
we focus on variations introduced luring design and manufacturing, effectively introducing a stochastic nature to the 
modeling parameters such as stiffness, mass, and damping. 

Examples of design, manufactu ring, and assembly variations having significant impact on system vibrations signals 
have been found throughout our research. As a first example, Figure 1 shows a schematic of a helicopter transmission 
for an OH58 helicopter (Lewicki and Coy, 1987), as well as a plot of experimental data we have collected using a test 
rig which houses such a transmission box (Huff et al., 2000). The different lines correspond to four different assembly 
instances of the same transmission box. Vibration data were collected for each assembly instance. Within each 
instance, three variables were varied (namely torque, mast lift and mast bending forces) using a factorial experimental 
design. As shown, the overall vibration levels (total power) varied significantly depending on the test conditions 
defined by the four experimental variables (Huff et al., 2000). 

As a second example. Figure 2 shows a theoretical plot of the frequency spectrum from one of the gear systems 
contained in the helicopter transmission, based on our empirical observations (Huff et al., 2002). The geometry of 
the gear system (epicyclic gears) includes four smaller gears (planet gears) revolving around a larger gear (sun gear) 
(Smith, 1999). In this example, the theoretical epicyclic gear mesh frequency for a single planet would fall on 99 
in the x-axis (equal to the number of teeth), as shown in black in Figure 2, followed by a set of harmonics. For a 
more realistic system, the exact epicyclic gear mesh frequency appears at frequencies clustered around the theoretical 
frequency value due to the spacing variations between planet gears. Figure 2 shows the frequency clustering for two 
sets of equally-spaced planet gears ( shown in red), as opposed to four equally-spaced planet gears (shown in blue). The 
spacing between the planet gears is subject to design variations, which result in the observed difference in frequency 
distributions, which in turn can invalidate the signal modeling assumptions (Huff et al., 2002). 

1.3 Probabilistic Variation Analysis in Design 

A significant degree of variation is introduced during the design, manufacturing, and assembly of components that 
make up aircraft systems. Standard tolerance variation analysis methods used in design address this variability by 
predicting the total variation in the final system (Creveling, 1997). Because we are starting from similar variation 
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Figure 1: Variations j n Vibration Levels in a Rotorcraft Transmission. 

sources, this approach will be explored and extended here to dynamic models of complex systems to predict the 
variation in vibration response chaiacteristics. 

A simple mechanical assembly is shown in Figure 3, where three rectangular blocks of dimension X}, X 2 , and Xj 
are designed and manufactured to it within the allowable space of dimension Y. Due to the inherently probabilistic 
nature of the manufacturing process, each of the dimensions is assigned specific tolerances based on a distribution set 
by the designer (either based on en pirical manufacturing data or process capability specifications (Creveling, 1997).) 
Typically, statistical tolerance analysis techniques are applied to geometric models of such assemblies to predict the 
magnitude and range of the variations in critical assembly features. For example, a Monte Carlo simulation approach 
is shown in Figure 3 to perform tolerance analysis for each manufacturing and design parameter (Hammersley and 
Handscomb, 1964; Creveling, 1997). Values of each parameter X, are drawn randomly from an assumed distribution 
function, and then combined through a functional model to determine the corresponding values for the final variable 
of interest. The statistical moments are then computed for the resultant values, which in tum are used to determine the 
probability distribution that matches the final assembly variable Y . 

2 Monte Carlo Methods: Summary and Example 

In this paper, we explore the application of Monte Carlo methods to variation modeling for the purpose of determining 
performance limits of complex dynamic systems. This section presents the fundamentals of such an approach using a 
simple design example. 
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Typical Frequency Distribution from an epicydic gear set with a 99-tooth earner gear (ttme-synchronously averaged): 



Black: a single planet gear (ideal) — > planet gear with 99 teeth, sidebands, and harmonics 

Red: 2 -sets of equally '•paced pbniit.v — > nmlriple.s ot '2 

Blue: 4 equally spaced planets — > multiples ot 4 



Figure 2: Variations in the Frequency Response in Epicyclic Gears. 



ASSEMBLY FUNCTION: 
Y-KX,.X 2 . ... X n ) 



Figure 3: Application of Statistical Methods to Tolerancing. 

Conceptually, Monte Carlo simulation is simple and elegant (Metropolis and Ulam, 1949; Hammersley and Hand- 
scomb, 1964). Consider some func ion 

y = f(x i,x 2j . ..,*«)> W 

where y is a known function of random variables x\ ,.*2, ■ We assume that each x t has a known random nature and 
all the Xi s are statistically independent. The question we wish to answer (or simulate) is: what is the random nature 
of y? 

To determine the random nature of y, a random sample is generated for each jq. Using the known function / (some 
system/performance model), y is generated next. Depending on the information needed from the random nature of y 
(perhaps a mean p and standard de\ iation a, or the number of times y exceeds some value out of 1000 trials, etc.) the 
value ofy or some sort of frequency count is recorded. 

As an example, consider the design of a helical coil spring to achieve some specific spring constant k. The relation 
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between the performance parameter k and the design variables is 


d A G 

~ 8D 3 A^’ 


( 2 ) 


with d the wire diameter out of which the spring is made, G the shear modulus of the spring material, D the diameter 
of the spring (helix diameter), and .V the total number active turns or coils of the spring. As a first pass, a deterministic 
model with d- 1.5 mm , G = 79 GPa, D = 18.0 mm , and N = \3 turns gives k = 660/V/m. In reality, the values of d , 
G, A and N do not always take on the same precise values for each spring that is manufactured. Thus, a more accurate 
(with regard to how well it represents reality) design model would be one which considers the way the variations of d, 
G, D , and N cause a variation in k. 

For cases where the function / is simply represented and smooth enough to provide second derivatives, a low- 
order Taylor series approximation for the mean of y can be expressed as below, with the partial derivatives evaluated 
at jc, - ^ (Hahn and Shapiro, 1994; McAdams and Wood, 2000): 

1 n d 2 f 

Py — f(px 1 5 Px2 j • • • j px n ) 2 2 0^2 V ar ( x i ) * ^ 


Similarly, a low-order approximati )n for the variance of y can be expressed as: 


Var(xi). 


"-“-Ke 

Equations (3) and (4) can be applied to Eq. (2) to yield: 


IU = + 1 Var(d) 

ItiJn 




(4) 


(5) 


and, 

V*i*> = ^ 2v “W + ^ 2v ° r W ( 6 ) 

+ C$fa) 2 Var(D) + ($$?Var{N). 

Substituting d = 1.5 mm, G = 79 GPa , and D = 18.0 mm for the average values /v, Hg, Md, and taking Var(d) = 
2.5 x 10 -5 mm, Var(G) = 6.9 GPa, Var(D) = 18.6x 10 -3 mm, andVar(N) = 1.87x 10“ 3 tums(Shigley andMischke, 
2001) for the variations gives ^ = 660 N/m and Var{k) — 27 ,600 N / m. Translating this into a mechanical tolerance 
using a common convention assum ng a random variable (i.e., tolerances = 3<7 f = 3 y/(Var(x))) gives 498 N/m. 

Using Eqs. (3) and (4) allows designers a starting point to understand, and compensate or design for, the effects 
of variation. Nevertheless, this approximate approach has a number of key shortcomings that become apparent and 
critical as we explore more complex systems and the compound effects of different types of variation. Of critical 
importance here are that: a) as engineering models become complex and computational, Eqs. (3) and (4) fail to 
provide tractable analysis, and b) these two equations give us limited, and at times misleading, information about the 
probability distribution function of y. As an example, consider the relation y = sin(x). Using Eqs. (3) and (4), and 
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taking x to be a random variable from a standard normal distribution gives g y = 0 and <3 y = 1 . Such a result may lead a 
designer to the notion thaty can be modeled as a variable from a standard normal distribution. If this notion were used 
to make parameter specifications c r expectations of failure, important errors could occur. Shown in Fig. 4 is a plot of 
the probability density function of y . The probability density function for y is determined by applying a coordinate 
transformation theorem from statistics (Eisen, 1969). A key restriction of this theorem is that the mapping of v = f(x) 
be one to one, which is violated in our simple spring example. 



Figure 4: The pdf of y (y - sin(x), x is a normal variable.) 


Returning to the spring example, we now use Monte Carlo simulation to explore the variation in k as a function of 
the variations in d, G, D, and N. The histogram in Fig. 5 is generated performing a Monte Carlo simulation as outlined 
earlier in this section. Based on this simulation, there were no springs (out of a sample run of 100,000 springs) that 
fell below k = 660 - 498 N/m and above k = 660 4- 498 N/m (taking the tolerance 498 N/m). This is compared to 
270 (.27% from three-sigma tolerincing) if k were treated as a normally distributed random variable. The standard 
deviation of the Monte Carlo simulated springs is 17.5 N/m leading to a 3a tolerance of 52.5 N/m . The significant 
difference between the Monte Carlo simulated variation and that approximated by Eq. 4 is due to the non-linearity of 
Eq. 2. Also, this comparison highlights the potential for engineering errors (in this case likely of a conservative nature) 
that would be made based on simple, linearized, analytic models such as those given by Eqs. 3 and 4. 

This short review and comparison of approaches to represent variation in design and manufacturing highlights 
some of the potential advantages O'* Monte Carlo simulation. In summary, with the minimal penalty of some compu- 
tation time, Monte Carlo simulation provides more useful information for the designer. Based on this insight, we use 
Monte Carlo simulation to explore how different sources of variation combine in more complex systems to influence 
the overall response and performance of a dynamic system. 
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Figure 5: Histogram of k generated using Monte Carlo simulation. 


3 Application: Cam-Follower Response 

A lumped-parameter, seven degret -of- freedom (fourteenth-order) model of a cam follower is used in this paper as 
an example of a complex nonlinear system. The cam-follower system is shown in Figure 6(a), and a schematic of 
the model is shown in Figure 6(b). adapted from (Grewal and Newcombe, 1988) and (McAdams and Wood, 1996). 
The parameter values for the cam-lollower system were taken from (Grewal and Newcombe, 1988), and are listed in 
Table 1. The equations of motion for the model are: 


/ c 0 

= -c s/ ( 0 c -e,)-^/( 0 c -e,) 



cA r CJ 

(7) 

M c y i 

= -C V5 y\ - K vs y\ - F c cos<D 




(8) 

M r y 2 

= -Cf{yi~h) - K f (y 2 -yi) 



+F C cosO - F p , 

(9) 

M/yj 

= C/(y2—y?>) + Kf(yi _ J3) 
-C 4 (y3 - y 4 ) - K 4 (y3 - y^) 



£ 

1 

u? 

I 

(10) 

M 3 y 4 

= C 4 (y 3 - >’ 4 ) + K 4 (y 3 - V 4 ) 



-C 3 (.V4 -V 5 ) - K 3 (y 4 ~y 5 ), 

(ii) 

A/2> : 5 

= C 3 {y 4 - y 5 ) + K 3 {y 4 - y 5 ) 


and, 

-Ci(ys -yt) ~ K 2(y5~y6), 

(12) 
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(a) Schematic. (b) The dynamic model. 

Figure 6 : Example: Cam-follower System. 


Miy 6 = C 2 (ys -ys) + Kiiys -ys) 

-Ciy 6 -K iy6 , (13) 

where 9 , is the input position, K s / and C s f model the damping and stiffness of the cam drive shaft, C* accounts for 
friction losses in the drive shaft herring, M c is the mass of the cam itself, and I c is the cam moment of inertia about its 
center of rotation. To account for the flexure of the shaft, a shaft stiffness, K vs , and a damping, C vs have been added. 
The offset of the cam follower from the center of the rotation of the cam is e, Kh accounts for deformation at the 
roller-cam interface, and M r is the mass of the roller. The inertia of the roller is assumed to have a negligible effect 
on the rotational dynamics of the svstem. The mass of the follower is My, with Kj and Cj the structural stiffness and 
damping of the follower, respectively. C c * accounts for the friction at the interface of the follower and the follower 
guide, F c b is the force that results lor this friction, and, F w is the external load on the follower. The spring has been 
modeled as three elements to approximate the distributed mass of the spring. K\, K 2 , and Kj are the distributed spring 
constants. The structural damping of the spring is approximated as C\, C 2 and C 2 . Mi, M 2 , and M 3 are the mass of the 
spring. The state-space equations were integrated using a Runge-Kutta integration routine. A simple harmonic motion 
(SHM) cam profile with a maximum rise of ,0254m is used. The cam is assumed to rotate at a fixed rate of 1500 RPM 
(25 Hz). The numerical values for the constants used in the simulation of cam operation are presented in Table 1. 

In Figure 7, the velocity and acceleration responses of the cam follower (from variable y 2 in Figure 6 (b)) are 
shown. The dashed line shows the idealized follower velocities and accelerations as determined by differentiating the 
cam profile. The solid line shows the reality when system mass, stiffness, and the resulting dynamics are taken into 
consideration. 

In contrast. Figure 8 shows the velocity and acceleration responses of the cam follower with a profile error of 25 pm 




follower velocity (m/s) 
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Table 1: Constant Values for the Cam-Follower Dynamic Model. 


Element 

Variable 

Value 

cam moment of inertia 

/c 

,00091034*g/m 2 

cam shaft rotational damping 

Csf 

.01356iV m s/ rad 

cam shaft rotational stiffness 


2260C )Nmjrad 

drive shaft friction 

c b 

.W5N m- sjrad 

cam mass 

K 

.5011 Kg 

cam shaft horizontal damping 

c Vi 

752.9N s/m 

cam shaft horizontal stiffness 

K vi 

2.6 e 9 Njm 

system preload 


266.62N 

follower stiffness 

*/ 

\15.\e 6 N /m 

follower mass 

M f 

340kg 

follower damping ratio 

* 1 / 

.75 

follower damping 

C f 


external follower load 

F w 

100 N 

return spring stiffness 

ATi,2.3 

63000 Njm 

return spring mass 

Ml, 2,3 

,0221kg 

return spring damping ratio 


.075 

return spring damping 

Cl, 2, 3 

H„2 

cam eccentricity 

e 

.0190 5m 



angle [deg ees] 


follower velocity with dynamic 
idealized follower velocity 



follower acceleration with dynamics 
idealized follower acceleration 


Figure 7: Follower velocity and act deration per cam rotation with ideal cam surface smoothness and profile tolerance. 
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idealized follower velocity idealized follower acceleration 


Figure 8: Follower velocity a id acceleration per cam rotation with profile and surface variation on the cam. 

and a surface roughness of 2.0 pm added to the cam profile. The profile error is modeled using a deterministic offset, 
simulated on the cam surface by tie addition of a sinusoid of t p /3sin(nQ). In this case, t p is the profile tolerance and 
n was taken to be small compared to the forcing frequency (1500 RPM) and large with respect to the step size ot the 
simulation code. The surface roughness is modeled using a random number generator and transformation techniques 
to simulate the surface roughness. 

The addition of these geometric variations cause minimal change in follower velocity as a function of cam angle. 
However, the simulations show that a geometric variation in the cam causes a significantly different acceleration, with 
a large magnitude, in the follower The effective higher frequency and magnitude follower will cause significantly 
different vibrations on the system. Of particular relevance to our effort to simulate failure modes is that an increase in 
follower acceleration is related to an increase in the wear rate of the cam and follower (Rothbart, 1956). Also of key 
importance is that acceleration is generally the signal that is monitored for structural health status. Thus, the behavior 
of the acceleration signal is critical for accurate fault prediction and detection. 

4 Probabilistic Cam-follower Vibration Model 

Exploring the vibrational impact of variations in parameters such as spring stiffness provides a different simulation 
challenge. Parameter values of components vary from cam system to cam system, due to manufacturing and assembly 
variations. Because parts are replaced regularly during the lifecycle of systems, these variations are important to 
understand. For example, the spring constant on several cam systems can be distributed similarly to the distribution in 
Figure 5. In the end, vibration monitoring systems have to operate with generalized models of system response, with 
these types of variation included in such models. 

The core research question is two-fold: 1) how much product variation results from a random fluctuation in the 
manufactured parts?; and, 2) how d res response variation (e.g., vibration response distribution) relate to the parameters 
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Figure 9: Comparison of Power Spectral Densities for an Ideal Cam Profile vs. a Cam with profile tolerance and 
surface roughness added (high-frequency range zoomed-in). 


of a specific system being monito ed? The answer to these questions will allow for a more informative design of 
vehicle health monitoring systems. For example, the behavior of some set of cam systems would be used to determine 
performance metrics, and windows on the metrics for acceptable performance. In this section, we explore the effect 
of a variation in spring stiffness (in lerent from the manufacturing process) on a sampling of cam systems. 


4.1 Analysis of Cam-Follower Vibration Signatures 

Prior to analyzing the effect of design variations on the vibrational response, the vibration signature needs to be 
understood to decide on a possible set of features (vibration metrics) that will be used to monitor system performance 
and indicate the occurrence of failu es. A small sample of the simulated cam-follower vibration responses is shown in 
Figures 7 and 8 for half a revolution (for an ideal cam and a cam with profile errors, respectively). 12 revolutions of 
these signals are used to analyze the frequency content, with a sampling frequency of 10,000 Hz (the Nyquist cut-off 
frequency is 5,000 Hz.) 

The frequency content of these signals is shown in Figure 9. The first plot shows the entire set of frequencies 
computed from the two signals. Based on a careful analysis, the only difference in the frequency content due to the 
addition of profile and surface errors manifests itself in the higher frequency range. The second plot shows a zoomed- 
in portion of the higher-frequency range where the difference due to the two signals can be seen clearly. In general, 
the addition of the profile and surfac e errors introduces frequencies in the noise range, as well as increasing the overall 
power levels. 
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Many possibilities exist for selecting a feature set for the purposes of monitoring changes in the vibration signatures 
(Smith, 1999; Lewicki and Coy, 1987; Turner and Huff, 2001). In this paper, we first focus on the most most standard 
vibration monitoring feature, namely, the global measure of vibration levels. This measure can be computed as the 
area under the power spectral density plot in the frequency domain (equivalent to the variance in the time domain by 
Parseval’s theorem.) Because mos> of the changes due to the addition of surface errors to the cam profile are observed 
in the higher- frequency range shown in Figure 9 (~ 177 Hz to 250 Hz), we select the total power in this range as the 
vibration metric of interest for this study. 

4.2 Analysis of the Impact of Design Variations 

The signals defined and analyzed n the previous subsection were varied using the Monte Carlo simulation method. 
In this case, both the signal from he ideal cam and from the cam with profile and surface errors are used to deter- 
mine whether a random variation in the spring constants K\ , Kj, and K 3 (see model in Figure 6 (b)), similar to the 
helical spring explored earlier, will result in variations in the vibration metric of interest (e.g., total power in the 
high-frequency range). 

The spring constant tolerance model is developed by analogy with the earlier example in the paper. The spring 
constant mean is taken as 21,000 N/m with a standard deviation of 2.65% (660/17.5 = 0.0265) or 567 N/m. Recall 
that the spring that we explored before had a mean of 660 N/m and a standard deviation of 17.5 N/m. The spring 
was chosen as the element to vary because we can develop a reasonable tolerance model for this element (unlike the 
damping), and it is likely to have a larger effect on the vibrational response than one of the other parameters. 

N = 200 number of trials are generated using the Monte Carlo simulation method (minimum number of trials 
required (Creveling, 1997)). A plot of the selected vibration metric is shown in Figure 10 for the case of the ideal cam 
profile and the cam profile with errors. As observed, the overall vibration levels and the variance in these levels are 
higher for the case of cam profile u. ith errors. 

The statistics (mean, standard deviation, skewness, kurtosis) of the vibration data generated using MC simulation 
are summarized in Table 2 for all ol the frequency ranges for comparison. Using the high-frequency range once again, 
the ideal profile case results in a mean value of 62,967.00 and a standard deviation of 83.98, resulting in a tolerance 
of 251.95. The error profile case remits in a mean value of 69,250.00 and a standard deviation of 3,468.50, resulting 
in a tolerance of 10,404.00 for the overall vibration metric. 

Recall from the earlier review of Monte Carlo techniques that the standard approach to computing tolerances 
(using Equations 3 and 4) based or the complex mathematical relationship between the design parameters (d, G, D, 
and N) and the vibration response {sum of the total power in y 3 ) would have been intractable and highly simplistic 
(linearized.) This computational approach provides the vehicle monitoring system designer with the possible ranges 
of expected values of the vibration monitoring metric, based on the random variation in the selected subset of design 
parameters. Figure 1 1 shows the si atistical distribution of the high-frequency vibration power values for both cases 
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Figure 10: Total Power in the Hig i-Frequency range for an Ideal Cam vs. a Cam with profile tolerance and surface 
roughness added. 


Table 2: Statistics of Total Power Changes due to MC simulation. 




Ideal Profile 



Error Profile 


Freq Range 

Mean 

St Dev 

Skew 

Kurt 

Mean 

St Dev 

Skew 

Kurt 

Total 

: 3 1670.00 

82.51 

-0.23 

3.35 

249930.00 

3468.4 

-0.25 

3.15 

Low- Freq 

163880.00 

0.54 

-0.06 

3.07 

164120.00 

143.27 

-0.21 

3.03 

High-Freq 

n2967.00 

83.98 

-0.22 

3.35 

69250.00 

3468.5 

-0.25 

3.18 


(total number bins is 20.) As obsen ed, the vibration metrics for both cases follow a normal distribution. However, the 
spread in the vibration metric computed from the case of cam profile with errors is much larger in value than the ideal 
cam profile case. 

4.3 Discussion 

Several observations can be made based on these analysis results. First, in addition to the mean levels of the vibration 
metric being larger, the variance in the value of the vibration metric due to the variation of the spring constant is larger 
(approximately a factor of 40) in the case of the cam with surface errors. This implies a greater impact of component 
variations on the vibration response of the (more realistic) cam with profile and surface errors. As a result, the models 
used for vehicle health monitoring systems not only have to take the variation in the design parameters into account, 
but also model the profile and surface errors more accurately, which is nonexistent from current models. 

Second, the effect of the random variation in the spring constant ( K ) variable on the vibration metric is quite 
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Figure 11: Histogram of the Probability Distribution of the Total Power in the High-Frequency range for an Ideal 
Cam vs. a Cam with profile tolerance and surface roughness added. 

significant, as observed by the high variance value. The mathematical relationship describing the vibration metric 
selected in this study would have to be modified to add the expected variation which has propagated through the 
complex dynamic system, and resolted in the computed variation. In addition, the values of the metric within the 
computed variation range will have to be stored to assure the elimination of false alarms: in other words, training 
of the data must include the variaiion that has propagated through the system, so that anomalies are not identified 
incorrectly. 

Let us revisit the situation desciibed in Figure 1, where the four experimental factors (mast lift, mast bend, torque, 
and assembly) resulted in significant differences in vibration levels. The question those empirical observations brought 
up was whether any of these vibration levels were ’’acceptable”. A probabilistic approach as described in this paper 
will enable the designer to set the limits of the vibration levels according to the mathematical model of the OH58 
test rig vibrations, which will then identify which of the test conditions fall within the acceptable limits of variation. 
A similar approach can be followed for the situation described in Figure 2, where the vibration metric would be the 
power level at each of the frequencies, and angular variations in the placement of the planet gears can be propagated 
through the system to determine fui ther effects. 
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5 Closure 

This paper addresses the problem t-f incorrect modeling assumptions made when designing vehicle health monitoring 
systems, resulting in high rates of alse alarms and missed detections. The specific problem that was addressed is the 
necessity of including the effect o ' statistical variations introduced during the design and manufacturing of rotating 
machinery components that make up most aerospace systems. The propagation of such significant variations through 
the system and their effect on the f nal monitoring metric of interest is typically unknown. In this paper, probabilistic 
methods (e.g., Monte Carlo simulation) are used to describe the nature of the variations in the system response due 
to variations in a subset of design parameters. The results show significant variation that must be taken into account 
using probabilistic models. 

The paper presents an initial feasibility of enhancing deterministic dynamic models of complex systems by com- 
bining them with probabilistic models. Only a subset of design parameters (those describing the spring constant K) 
were considered in this paper. For a more thorough analysis, a full MC simulation is needed on all the parameters, 
followed by a sensitivity analysis. I urthermore, careful statistical tests need to be performed to determine the nature of 
the parameter distributions resulting from the MC simulation. Finally, the paper uses a simple cam-follower system. 
Future work will attack the problem of high-risk aerospace systems with much more complex system models. As 
demonstrated in this paper, the effect of surface and profile errors requires special attention in such complex system. 
Ongoing work focuses on developing finite difference models of rotorcraft transmission systems and aircraft engine 
gear systems. These models will oe used to determine whether and how the design and manufacturing variations 
propagate through the systems, and how they can be represented in the signal modeling assumptions for vehicle health 
monitoring systems. Using this approach, variational models can be developed without reliance on systems that are 
simply expressed parametrically. 
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